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Abstract 

A  technique  for  the  recognition  of  complex  three  dimensional  objects  is  presented.  The  complex  3-D  objects 
are  represented  in  terms  of  their  3-D  moment  invariants,  algebraic  expressions  that  remain  invariant  inde¬ 
pendent  of  the  3-D  objects'  orientations  and  locations  in  the  field  of  view.  The  technique  of  3-D  moment 
invariants  has  been  used  successfully  for  simple  3*D  object  recognition  in  the  past.  In  this  work  we  have 
extended  this  method  for  the  representation  of  more  complex  objects.  Two  complex  objects  are  represented 
digitally;  their  3-D  moment  invariants  have  been  calculated,  and  then  the  lnvarlancy  of  these  3-D  invariant 
moment  expressions  is  verified  by  changing  the  orientation  and  the  location  of  the  objects  In  the  field  of 
view. 

The  results  of  this  study  have  significant  impact  on  3-D  robotic  vision,  3-D  target  recognition,  scene 
analysis  and  artificial  intelligence. 


Introduction 


In  order  for  machines  or  robots  to  recognize  three-dimensional  (3-D)  objects,  it  la  crucial  for  them  to  go 
beyond  two  dimensional  signal  processing  and  to  exploit  the  three-dimensional  nature  of  the  objects.  Three 
dimensional  object  recognition  usually  Involve*  acquiring  3-D  data  about  an  object,  extracting  discriminant 
and  invariant  features  from  the  data  and  then,  based  on  these  features,  making  decisions  about  the  identity 
of  the  object.  One  way  of  acquiring  3-D  data  about  an  object  Is  through  the  use  of  range  Information  that 
can  be  obtained  both  passively  and  actively.  A  survey  of  the  various  range  finding  techniques  can  be 
found  in  a  recent  article  by  Jarvis.1 

The  next  step  in  the  recognition  process  after  range  acquisition  is  to  extract  features  that  are  peculiar 
to  the  object  and  which  are  invariant  to  its  position  and  orientation  In  the  field  of  view.  In  this  paper  I 
explore  the  feasibility  of  the  use  of  3-D  moment  Invariants  as  such  features  for  complex  object  recognition. 
In  I960  Sadjadi  and  Hail2  Introduced  3-D  moment  Invariants  and  used  it  for  recognizing  a  sat  of  geometrical 
3-D  objects.  Three  dimensional  moment  Invariants  are  a  finite  set  rtiich  can  represent  three  dimensional 
objects  independent  of  any  coordinate  system.  These  moment  Invariants  are  obtained  by  relating  3-D  statisti¬ 
cal  momenta  and  ternary  quantica,  the  study  of  which  Is  part  of  the  theory  of  Invariant  algebra.  In  1982 
Bjorklund  and  Lo*3  used  3-D  moment  Invariants  for  identifying  box -shaped  targets  In  range  Imagery.  They 
showed  that  the  3-D  moment  Invariants  of  the  targets  are  different  enough  to  suggest  their  use  for  target 
classification . 

In  this  paper  two  different  objects  of  different  complexities,  a  toy  truck  and  a  toy  airplane,  are  ex¬ 
pressed  digitally  in  terns  of  two  sets  of  3-D  points.  Than  their  3-D  moment  Invariants  are  evaluated  and  it 
is  shown  that  these  features  not  only  are  Invariant  to  position  and  orientation,  but  can  be  used  to  dis¬ 
tinguish  the  two  complex  objects  from  each  other. 

Three-dimensional  Moment  Invariants 


Definitions  and  derivations 

The  three  dimensional  moments  of  order  p  +  q  ♦  r  of  a  density  p(x.,x2,x.)  are  defined  In  terms  of  the 
Reiman  integral  as;  J 
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The  moment  generating  function  for  three  dimensional  moments  say  be  defined  aai 


M(u1.u2,u3) 
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Using  these  definitions  and  applying  the  fundamental  theorem  of  three  dimensional  moment  invariants  2  it 
can  be  concluded  that  algebraic  expressions  involving  three  dimensional  moments  can  be  derived  which  have 
the  property  of  invariancy  with  respect  to  any  coordinate  system.  The  derivations  of  these  expressions  rely 
on  the  theory  of  invariant  algebra. 

The  study  of  ternary  quadratics,  which  is  used  in  the  derivation  of  three  dimensional  moment  invariants, 
leads  to  the  study  of  conics,  from  which  a  set  of  two  moment  invariants  is  obtained. 
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3-D  Moment  Invariants  of  Complex  Objects 

Two  objects,  a  toy  truck  and  a  toy  airplane,  were  put  in  arbitraty  positions  with  arbitrary  orientations 
in  the  xyz  space.  Figure  1  displays  these  objects  end  shows  their  dimensions.  Bach  object  was  represented 
by  a  finite  though  large  set  of  discreet  points  that  were  obtained  manually.  A  set  of  3-D  moment  invariants 
for  each  object  in  three  different  and  random  positions  and  orientations  In  space  was  than  obtained.  Tables 
I  and  II  show  the  values  of  the  3-D  moment  invariants  for  the  two  objects  at  different  locations  and  orienta¬ 
tions.  The  means  and  standard  deviations  of  the  3'D  moment  invariants  for  the  two  objects  are  shown  in 
Table  III.  As  can  be  seen  from  the  tables,  tha  3-D  moment  invariants  remain  virtually  invariant  regardless 
of  the  objects'  positions  and  orientations  in  space.  The  slight  variations  that  occur,  as  can  be  seen  from 
the  means  and  standard  deviations  in  Table  III,  are  Insignificant.  Furthermore,  the  3-D  moment  Invariants 
of  the  truck  and  the  airplane  are  different  enough  to  make  it  possible  to  classify  these  two  objects  by  mesns 
of  the  values  of  their  moment  invariants. 

srMrr 


In  this  paper  the  feasibility  of  using  3-D  moment  invariants  as  an  invariant  and  discriminatory  attribute 
of  three  dimenaional  complex  objects  was  addressed.  Two  different  objects  of  different  complexities  were 
represented  by  sets  of  discreet  3-D  points  and  the  Invariancy  of  the  3-D  moments  for  these  objects  in  differ¬ 
ent  positions  and  orientations  in  a  scene  was  shown.  Furtharmore,  it  was  shown  that  the  3-D  moment  Invariants 
for  these  objects  are  different  enough  to  make  their  recognition  based  on  the  values  of  their  3-D  moments 
possible . 

These  results  are  sl^iif leant  in  that  they  demonstrate  that  i)  the  3-D  moment  invariants  of  these  two 
objects,  which  are  not  composed  of  simple  quadratic  surfaces,  remain  Invariant  independent  of  their  systems 
of  reference,  and  11)  these  3-D  moment  invariants  are  different  enough  to  make  classification  of  the 
complex  objects  possible.  These  experimental  results  provide  further  impetus  for  using  3-D  moment  invariants 
as  a  discriminatory  and  Invariant  feature  for  machine  and  robotic  recognition  of  any  3-D  object. 
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Table  I.  The  3-D  Moment  Invariants  of  the  Truck 


Table  II.  The  3-D  Moment  Invariants  of  the  Plane 
Position  # 


4.236862 

4.257695 

4.257695 


0.01614955 

0.01609848 

0.01609848 


Table  III.  The  Means  and  Standard  Deviations  of  the 
3-D  Moment  Invariants  of  the  Objects 


Mean 

Standard 

Mean 

Standard 

Deviation 

Deviation 

4.250751 

0.009820770 

0.016116 

0.0000240? 5 

5.261821 

0.005876207 

0.007369 

0.002731683 
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Figure  1.  The  two  objects  used  In  the  experiment  at  three  positions  snd  orientations. 
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